Training Recurrent Neural Networks by a Hybrid PSO-Cuckoo Search Algorithm for Problems Optimization

نویسندگان

  • Ruba Talal Ibrahim
  • Zahraa Tariq Mohammed
  • Nazri Mohd Nawi
  • Abdullah khan
  • M. Z. Rehman
  • Maslina Abdul Aziz
  • Tutut Herawan
  • Jemal H. Abawajy
  • Jeng-Fung Chen
  • N. M. Nawi
  • A. Khan
  • Abdullah Khan
  • Z. Rehman
  • Haruna Chiroma
چکیده

Because of computational drawbacks of conventional numerical methods in solving complex optimization problems, researchers may have to rely on meta-heuristic algorithms. Particle swarm optimization (PSO) is one of the most widely used algorithms due to its simplicity of implementation and fast convergence speed. Also, the cuckoo search algorithm is a recently developed meta-heuristic optimization algorithm, which is suitable for solving optimization problems .Normally, the parameters of the cuckoo search are kept constant. This may make algorithm suffering from slow convergence rate. To overcome with this issue, a hybrid algorithm called (PSO-CS classifier)for adjusting the cuckoo search parameters is presented to improved cuckoo search algorithm by particle swarm optimization (PSO) for training recurrent neural network which its weights and bias trained using the (PSO-CS classifier) to deviate from being stuck in local minima) for two benchmark classification problems. Moreover, to combine the ability of social communication in PSO with the local search capability of CS .Finally, the performance of the proposed algorithm is compared with that of the standard cuckoo search and PSO Algorithms. The simulation results show that the proposed (PSO-CS classifier)

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Training Artificial Neural Networks by a Hybrid PSO-CS Algorithm

Presenting a satisfactory and efficient training algorithm for artificial neural networks (ANN) has been a challenging task in the supervised learning area. Particle swarm optimization (PSO) is one of the most widely used algorithms due to its simplicity of implementation and fast convergence speed. On the other hand, Cuckoo Search (CS) algorithm has been proven to have a good ability for findi...

متن کامل

Metaheuristic Optimization Algorithms for Training Artificial Neural Networks

Training neural networks is a complex task that is important for supervised learning. A few metaheuristic optimization techniques have been applied to increase the effectiveness of the training process. The Cuckoo Search (CS) algorithm is a recently developed meta-heuristic optimization algorithm which is suitable for solving optimization problems. In this paper, Cuckoo search is implemented in...

متن کامل

A Hybrid Ga/pso to Evolve Artificial Recurrent Neural Networks

In this paper we propose a novel hybrid algorithm (GA/PSO) combining the strengths of particle swarm optimization with genetic algorithms to evolve the weights of recurrent neural networks. Particle swarm optimization and genetic algorithms are two optimization techniques that have proven to be successful in solving difficult problems, in particular both can successfully evolve recurrent neural...

متن کامل

Weight Optimization in Recurrent Neural Networks with Hybrid Metaheuristic Cuckoo Search Techniques for Data Classification

Recurrent neural network (RNN) has been widely used as a tool in the data classification. This network can be educated with gradient descent back propagation. However, traditional training algorithms have some drawbacks such as slow speed of convergence being not definite to find the global minimum of the error function since gradient descent may get stuck in local minima. As a solution, nature...

متن کامل

CSBPRNN: A New Hybridization Technique Using Cuckoo Search to Train Back Propagation Recurrent Neural Network

Nature inspired metaheuristic algorithms provide derivative-free solution to optimize complex problems. Cuckoo Search (CS) algorithm is one of the most modern addition to the group of nature inspired optimization metaheuristics. The Simple Recurrent Networks (SRN) were initially trained by Elman with the standard back propagation (SBP) learning algorithm which is less capable and often takes en...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2017